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ABSTRACT-1' 


This  report  describes  an  experimental  system  for  designing 
free-form  B-spline  surfaces  using  a head-mounted  display.  In 
this  system,  the  interaction  with  the  surfaces  tekes  place  in 
three  dimensions  as  the  designed  object’s  shape  is  updated  in 
roal-t  ilno.  The  report  also  examines  some  of  the  problems  that 
should  be  solved  in  building  a practical  three-dimensional 
computer-aided  geometric  design  system  for  surfaces. 


’’This  report  reproduces  a dissertation  of  the  same  title 
nuhmitled  to  the  department  of  Computer  Science,  University  of 
Utah,  in  partial  fulfillment  of  the  ruyuireiiients  for  the  degree 
of  Doctor  of  Philosophy. 


v 


CHAPTER  I 


INTRODUCTION 


Typically,  three-dimensional  computer-aided  geometric 
design  (CAD)  systems  have  primarily  been  experiments  on  the 
feasibility  of  a particular  mathematical  representation  like 
the  Coons  patch  or  Bfizier  patch  (1,2,3,4.5,22).  This  study 
focuees  primarily  on  the  problems  of  3-D  interaction  in  a 
three-dimensional  environment  using  a head-mounted  display  and 
3-D  wand.  The  particular  mathematical  formulation  on  which 
much  of  this  study  is  based  is  the  B-spline  (for  Basis-spline), 
which  was  first  proposed  in  a computer-aided  geometric  design 
context  by  R.  F.  R i esenf e I d (6) . 

This  work  has  been  done  with  three  global  objectives  in 
mind.  The  first  objective  was  that  the  interaction  with  the 
3-D  surfaces  actually  take  place  in  three  dimensions  rather 
than  with  various  two  dimensional  orthographic  and  perspective 
projections.  The  devices  used  to  accomplish  this  objective 
were  a head-mounted  display  and  a 3-D  wand.  The  head-mounted 
display  was  built  by  Ivan  E.  Sutherland  and  coworkers  at 
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Harvard  Univerei ty t7] . This  display  was  move. I to  the 
University  of  Utah  when  Ivan  Sutherland  joined  the  faculty 
here. 


Thie  3-D  interaction  objective  also  required  that  a device 
be  available  that  allows  the  user  to  communicate  the  geometric 
positional  information  to  the  system.  A 3-D  wand  to  allow  this 
type  of  interaction  wae  constructed  at  the  University  of  Utah 
and  used  in  this  system. 


The  second  objective  In  building  this  system  was  that  it 
be  very  cloee  to  real-time  in  response.  The  system  should 
appear  to  the  user  to  respond  Instantaneously,  or  at  least 
delays  in  response  should  bs  no  greater  than  one  or  two  seconds 
in  the  worst  case  and  far  less  in  most  cases.  In  my  opinion, 
thle  requirement  is  a very  important  one  to  impose  on  a 
computer-aided  design  system.  When  we  sculpture  an  object  in 
clay  we  always  get  Immediate  response.  To  be  forced  to  wait 
four  or  five  seconds  to  sse  the  results  of  deformations  made  to 
an  object  can  be  very  frustrating,  as  anyone  who  has  used  a CAD 
system  that  responds  in  this  way  knows.  The  user  can  lose 
sight  of  creative  ideas  during  these  waiting  periods. 
Therefore,  In  this  system  I have  attempted  to  shorten  the 
computation  algorithms  for  the  B-spline  surfaces  and  leave  as 
much  of  the  computation  as  possible  to  a special  purpose 
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graphics  processor. 

The  third  objective  of  this  system  was  to  provide  a 
mathematical  formulation  for  the  user  that  requires  little  or 
no  mathematical  background  on  his  part  In  order  that  he  be  able 
to  use  it  effectively.  This  restriction  seems  easy  to  satisfy. 
However,  when  coupled  with  the  requirement  that  the  formulation 
also  satisfy  the  physical  needs  of  dsrivative  continuity  and 
the  subjective  attribute  of  "fairness",  which  is  important  from 
a designer's  point  of  view,  the  requirement  is  more  difficult 
to  satisfy.  All  of  these  things  should  be  present  in  the 
mathematical  representation  with  no  explicit  intervention  by 
the  designer. 

It  Is  with  this  third  objective  that  B-splines  become 
Important,  for  they  intrinsically  yield  derivative  continuity 
across  patch  boundaries.  In  fact,  with  these  functions,  one 
must  explicitly  introduce  extra  definition  points  to  produce  a 
breakdown  in  continuity.  This  is  in  contrast  to  Coons  patch 
systems,  e.g.  Armit’s  Multipatch  [4]  and  Multiobject  15] 
systems,  or  BAzier’s  SystSme  UNISURF  [2]  , in  which  all 
derivative  continuity  across  patch  boundaries  must  be 
explicitly  dealt  with  by  ths  designer.  Moreover,  B-spline 
surfaces  are  locally  defined.  This  means,  for  example,  that 
changes  In  the  deoign  of  the  fender  of  a car  do  not  change  the 


hood  shape,  or  modifying  a nose  on  a bust  being  sculptured  does 
not  affect  the  shape  of  the  mouth.  These  considerations  are 
extremely  important  to  a tractable  three  dimensional  design 
environment. 

Ae  suggested  in  the  three  objectives  mentioned  above,  the 
main  goal  of  this  research  has  been  to  design  free-form  basis 
epline  surfaces,  in  particular  B-spline  surfaces,  in  a 3-D 
environment.  The  real-time  requirement  haB  made  necessary  that 
a wide  variety  of  special  purpose  display  and  digitization 
hardware  be  available.  Some  of  this  equipment  already  existed 
when  the  work  began,  but  some  of  it  was  acquired  or  built  to 
make  this  research  possible. 


CHAFTER  II 


MATHEMATICAL  FORMULATIONS 


II.l  Requirements  of  a Mathematical  Representation 


One  of  the  principal  problems  in  computer  aided  geometric 


design  le  the  representation  of  shape  information  in  the 


computer.  This  means  that  Me  are  more  concerned  uith  shapes 


than  uith  functions  of  the  form  y-f(x).  Representations  as 


functions  of  the  form  y-f(x)  have  a number  of  properties  that 


are  undesireable  in  a CAD  system,  the  uorst  of  Mhich  is  that 


for  general  kinds  of  shapes  they  are  multivalued  and  often  have 


Infinite  slopes.  Large  or  infinite  slopes  are  axis  dependent. 


What  is  needed  for  shape  descriptions  is  an  axis  independent 


representation.  The  representation  should  also  be  easy  to 


Input  and  to  output  to  a display.  Also,  the  internal  details 


of  the  representation  should  not  be  of  concern  to  the  designer. 


Because  of  the  inherent  difficulties  in  representing 


shapes  uith  this  type  of  functional  representation,  Coons  III, 


Forrest C8I , B6ziert23,  Gordon  191,  and  others  have  chosen  a 


parametric  vector-valued  representation  to  represent  the 


designed  shapes.  A curve  in  3-space  is  of  the  form 
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f (t)  - t x(t) , y(t) , z(t)  ] , 

where  t lea  parameter  that  varies  between  0 and  1.  This 
formulation  Is  axis  independent. 

Just  as  with  curves,  surfaces  (or  volumes,  etc.)  can  be 
represented  in  a number  of  different  forms.  The  form  z=f(x,y) 
is,  however,  uneuited  to  the  needs  of  geometric  CAD.  A form 
that  Is  suitable  for  this  class  of  problems  is 

f(s,t)  ■ t x(s,  t) , y(s,  t) , z(s,t)  ], 

where  both  s and  t are  parameters  that  vary  between  0 and  1. 

Prior  to  the  period  in  which  Coons  and  others  did  their 
initial  work  with  surfaces  for  geometric  CAD,  doubly  curved 
surfaces  were  avoided  whenever  possible  in  design  systems 
because  of  the  difficulties  in  representing  these  surfaces  by 
plane  projections  and  becauss  of  the  cost  of  manufacturing 
them.  When  complex  fillet  surfaces  were  needed  to  blend 

portions  of  castings  together,  the  job  of  interpreting  them  ’<as 
left  to  the  pattern  maker.  In  the  aircraft  industry  where  the 
shape  of  the  surface  is  critical  for  aerodynamic  reasons,  a 
technique  known  as  "lofting"  was  used.  This  lofting  procedure 
was  carried  out  by  specifying  families  of  mathematical  curves 
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at  a number  of  parallel  plane  sections  and  interpolating  a 
eurface  through  these  curve  sections.  This  technique  of  course 
breaks  down  when  the  surface  is  complex  enough  to  prevent 
definition  by  plane  parallel  curves. 


1 1. 2 Coons  and  Bfizier  Formulations. 


Coone  Patches. 

One  of  the  earliest  attempts  to  use  the  computer  in 
geometric  computer-aided  design  resulted  from  investigations 
Into  surface  representations  by  Steven  A.  Coons  at  M.I.T.  In 
his  report  til,  he  describes  a technique  for  blending  the 
boundary  curves  of  patches  together  in  a way  that  ensures 
derivative  and  positional  continuity  under  conditions  that  can 
easily  be  specified.  His  work  was  used  as  the  basis  for 
computer  aided  design  systems  by  ArmitE4],  FergusonI5],  and 
Peters  1221 . 

The  method  of  surface  description  developed  by  Coons 
consists  of  building  up  a pieceuise  continuous  surface  by 
assembling  together  surface  patches.  It  is  an  interpolation 

approach  because  each  patch  is  defined  by  a bivariate  Hermits 
type  interpolation  to  boundary  conditions  that  consist  of 
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functions  of  a single  variable.  Each  patch  i9  specified  by 
four  boundary  curves  and  possibly  higher  order  conditions  on 
these  boundaries.  The  only  restriction  on  these  boundary 
curves  is  the  "compatibility  constraint"  that  they  intersect  at 
four  corners.  They  are  not  restricted  to  be  planar  curves.  A 
patch  eide  may  even  be  degenerate,  thus  allowing  asymmetric 
triangular  patches.  Also,  patches  may  be  split  so  that 
complexity  is  introduced  only  where  the  shape  is  complex. 

The  following  discussion  of  the  Coons  formulation  closely 
follows  Forrest[10].  In  this  discussion,  Q*  s are  used  to 
denote  the  boundary  curves  that  define  the  surface  and  P’s  are 
used  to  denote  the  defined  surface. 

The  boundary  curves  of  a Coons  patch  are  denoted  by 
Q(0,v),  Q(l,v),  Q(u,0)  and  Q(u,l).  They  intersect  at  the 

points  Q(0,0),  Q(0,1),  Q(1,0)  and  Q(l,l)  (see  Figure  2.1). 
Using  an  abbreviated  notation,  we  let  i-0  or  1 and  j=0  or  1. 
The  boundary  curves  are  then  represented  by  Q(i,v)  and  Q(u,j) 
and  the  four  corners  by  Q(i,j).  The  cross  boundary ( tangent) 
slopes  are  represented  by  Q„(i,v)  and  Qv(u,j). 

Ue  can  now  construct  the  canonical  form  of  a Coons  patch 
satisfying  the  boundary  conditions  Q(i,v),  Qu(i,v),  Q(u,j)  and 
Q„(u, j) : 


L 
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P ( u , v ) - Q ( i , v ) f i (u)  + Qu( i , v)  g, (u) 

+ Q(u,j)  f j (u)  + Qv(u,  j)  g,(v)  (2.1) 

-Q(i,j)  f i (u)  f j (v)  - Qu ( i , j ) g,(u)  f j ( v) 

-Qv(i,j)  ft;j)  gjv)  - QUv ( i . j ) g*(u)  g,(v). 


Th8  f i * 8 are  functions  introduced  to  blend  the  boundary  curves 
together  and  the  g/s  blend  together  the  cross  boundary  slopes. 
The  form  for  the  f and  g blending  functions  that  gives  slope 
continuity  for  the  patches  is 


f e(  t) 
f i ( t) 

g«(t) 
and  g i ( t ) 


1 - 3tz  + 2t3, 
3tz  - 2t3, 
t - 2tz  + t3, 
-tz  + t3. 


(2.2) 


The  QUv( I , j ) terms  In  (2.1)  are  the  cross  partial  derivatives 
at  the  four  corners,  Coons  calls  these  the  "twist  vector" 
terms.  They  eliminate  unwanted  quasi-flat  regions  at  the 
corners  of  a patch. 


The  main  advantage  of  the  Coons  patch  of  (2.1)  is  that  it 
is  extremely  general.  The  boundary  curves  may  be  of  any  form 
whatever.  The  Coons  patch  can  therefore  be  joined  to  a 
previously  defined  surface  very  easily  so  long  as  the  curve 
defining  the  boundary  of  the  surface  Is  parame>  jZ0d. 
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The  main  disadvantage  of  the  form  of  (2.1)  is  the 
Inclusion  of  the  twist  vector  term.  These  terms,  representing 
the  cross  partial  derivative  of  the  surface  with  respect  to  the 
two  parameters  at  the  corners,  are  difficult  for  even  the 
mathematician  to  use.  Of  course  if  the  twist  vector  terms  are 
not  explicitly  dealt  with,  by  the  designer  in  a system,  that  is 
if  the  system  keeps  them  hidden  from  the  user,  then  they 
present  no  special  problem  aside  from  the  computation. 

B6zler  Patches. 

P.  Bfizier  of  Regie  Renault  in  Paris  has  developed  a 
system  for  curve  and  surface  reprssentat i on  [11] . It  is  not 

quite  as  general  as  the  Coons  method,  but  it  does  not  require 
that  the  user  have  as  detailed  a knowledge  of  the  formulation 
as  with  the  Coons  formulation.  Some  people  consider  this 
feature  an  advantage.  Arguments  for  this  point  of  view  will  be 
d I scuB8ed  in  section  1 1.5.  BAzier  methods  are  discussed  here 
because  they  form  the  basis  of  a system  that  is  actually  used 
to  design  automobiles  at  Renault  and  because  of  their  relation 
to  B-spl IneB. 

A BAzier  space  curve  is  a vector-valued  polynomial 
approximation  to  a polygon,  or  sequence  of  points,  ve,  vlt..., 
v,,  of  the  form 

i 

* 

- . - >. , . . 
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B.(s)  - f 0(3)  Ve  + f 1 (s)  V,  +...+  f.(s)  v„,  (2.3) 

where  the  f j (s)  turn  out  to  be  the  binomial  probability  density 
functions  (Bernstein  polynomials [9] ) . 

Figure  2.2  shows  the  binomial  basis  functions  for  m-5. 
Note  that  since  all  of  the  functions  except  f0  are  zero  uhen 
s-0,  the  curve  interpolates,  or  passes  through,  the  point  ve. 
Likewise,  since  all  except  f.  are  zero  when  s-1,  the  curve 
interpolates  at  v,.  All  other  points  control  the  global  shape 
of  the  curve  in  the  amount  of  the  weights  they  are  given  by 
their  respective  basis  functions. 

An  illustration  of  a Bfizier  curve  is  shown  in  Figure  2.3. 
An  Important  feature  of  this  type  of  curve  is  that  it.  lies 
entirely  within  the  convex  hull  of  the  points.  The  curve 

follows  the  global  shape  of  the  "control  polygon",  yet  it  is 
much  smoother. 

A surface  can  be  generated  by  a two  dimensional  array  of 
control  points,  using  for  the  weighting  functions  the  tensor 
product  of  the  univariate  weighting(or  basis)  functions.  The 
tensor  product  basis  functions  are 

fj,k(e,t)  - f j ( 8 ) fk(t),  (2.4) 


Figure  2.3  Bezier  Curve  for  a 9-sided  Polygon 
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giving  for  the  surface  equation 


S„,„ ( 9,  t ) “fee(e,t)  vM  + fails,  t)  Vet  +...+  f mo ( s , t ) v.,„. 


A tuo  dimensional  control  point  array  and  the  generated 


B6z i er 

surface  are  shown  in  Figure  2.4.  Since 

this  is 

a tensor 

product 

form,  the  surface  interpolates  the 

points 

at 

the 

corners 

of  the  control  net.  The  boundary 

curves 

are 

the 

uni varl 

ate  curves  associated  with  the  bounding  points 

i n 

the 

contro 1 

net. 

1 1. 3 Local  Basis  Formulations. 


B-sp I I nes. 

The  first  work  with  B-spI  ines  in  a computer  aided 
geometric  design  context  was  done  by  Richard  F.  Riesenfeld  and 
is  reported  in  his  Ph.D.  thesis  at  Syracuse  Uni versi ty  [6J . In 
the  following  discussion  of  B-spI ines  we  ui  I I use  an  approach 
that  more  closely  follows  a development  due  to  Coons  [121. 

In  defining  the  shape  of  an  object  we  might  like  to  be 
able  to  define  the  positions  of  a number  of  points  on  it  and 


have  the  computer  program  use  a suitable  formulation  to  "fill 
in"  the  regions  of  the  object  not  explicitly  defined  by  the 
points.  The  number  of  defining  points  should  not  be  too  large 
if  the  surface  is  not  complicated.  Vet  if  the  eurface  is 

complicated  we  cannot  expect  any  mathematical  formulation  to  be 
able  to  describe  the  surface  adequately  uith  just  a feu 
definition  po i nts. 

Suppose  we  have  an  ordered  sequence  of  points  in  3-space, 
(ve,  vlt . . . , vq) , that  we  wish  to  approximate  with  a curve.  The 
curve  is  to  be  piecewise,  i.e.  it  is  to  be  made  up  of 
segmentstspl ines) . It  is  to  be  continuous  to  first  derivative; 
each  segment  joins  to  the  next  with  tangent  continuity.  Ue 
make  no  assumption  about  the  degree  of  the  various  segments 
that  together  form  the  complete  curve  except  that  each  segment 
le  represented  by  a vector  function  of  the  form 

Pn  ( 8 ) - B0(s)  V„  + Bl(s)  Vj.n  + ...  + B„(s)  V„.n,  (2.5) 

where  the  functions  B,ts)  are  polynomials  of  degree  r in  the 
parameter  s. 

The  value  of  m is  not  yet  known;  it  is  for  now  less  than 
or  equal  to  q,  the  total  number  of  control  points.  It 
represents  the  number  of  points  affecting  the  shape  of  each 


segment.  Likewise,  r is  not  yet  specified.  It  is  simply  a 
positive  non-zero  integer. 


The  B j ( s)  functions  form  a set  of  basis  functions.  The 
goal  ie  to  find  what  form  these  functions  must  take  to  satisfy 
the  continuity  requirements.  This  means  that  we  must  determine 
the  coefficients  in  the  basis  functions  and  the  values  of  m and 


r.  Each  baeie  function  has  r+1  unknown  coefficients,  and  from 
(2.5)  ue  eee  that  there  are  m+1  basis  functions.  Therefore, 
there  nre  (m+1) (r+1)  unknown  coefficients. 


Imposing  the  continuity  requirement,  we  obtain  the 
fol lowing  relations: 


Pj*j(0)  - Pj(l), 
P'jm O)  - P'i(l). 


(2.6) 


These  require  that  the  basis  functions  be  of  the  form 


Bj (0)  - Bjm(1), 

B'j (0)  - BVi(l). 
B0(l)  - B'o(l)  - 0, 
B„(0)  - B'„(0)  - 0, 


(2.7) 


for  J-0,1, . . . ,m-l. 


■—  ■ 


Equations  2.7  make  up  2m+4  constraints  to  be  applied  to 
the  basis  functions.  We  obtain  1 additional  constraint  uhen  ue 


require  that  the  basis  functions  be  normalized,  that  is  they 
must  sum  to  1 f-r  all  values  of  the  parameter  s.  This  last 
condition  makes  a total  of  2m+5  constraints  on  the  (m+1) (r+1) 
unknowns.  Equating  thsse  two  quantities: 

(r+1)  (m+1)  * 2m+5, 


or 


r - 1 + 3/ (m+1).  (2.8) 

Obviously  this  implies  r-m-2,  since  r and  m must  both  be 
integers.  . 

From  the  conditions  of  (2.7),  the  normalization  condition 
and  the  restriction  of  m-2,  the  basis  functions  are  determined 
to  be: 


Be  ( 8 ) - (1-8)72, 

Bits)  - (-2e2  + 2e  + l)/2,  (2.9) 


A plot  of  these  functions  is  shown  in  Fiyure  2.5. 

The  same  argument  holds  for  higher  degrees  of  continuity. 
With  the  addition  to  (2.6)  of  the  requirement  that 
P"Vi(l)  - P"j(0),  we  see  that  for  this  case  the  functions  are 


Be(s) 

- B3(1-s), 

i 

B,  (s) 

- 6z(l-s) , 

(2.10) 

Bz(s) 

- (_83  + 3S2  + 3b  + l)/6, 

B3(s) 

- sV6. 

The  usua i tensor  product  form  for  surfaces  yields  for  the 
bivariate  B-spi inei 

Bj.v (s,  t)  - Bj(e)  Bk(t) . (2.11) 

A halftone  picture  of  the  bivariate  basis  corresponding  to 
(2.9)  i 8 shoun  in  Figure  2.6.  This  picture  was  generated  using 
the  Uatkins  process (13)  by  breaking  each  patch  into  16 
polygons.  This  is  a piot  of  the  functions  in  parameter  space. 
Each  function  has  been  plotted  separately  in  its  own  coordinate 
system,  and  the  coordinate  systems  have  been  displaced  in  such 
a way  as  to  illustrate  each  function  separately  and  at  the  same 
time  ehow  the  tangent  continuity  conditions  between  functions. 


- 
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Figure  2.7  shows  a set  of  points  that  has  been 

approximated  by  a curve  using  the  basis  functions  of  (2.9). 
Each  vertex  Is  Indicated  by  an  x.  Notice  that  the  curve 

interpolates  at  the  endpoints.  This  is  because  multiple 
vertices  occur  there,  and  hence  the  curve  is  degenerate  there. 
Figure  2.8  shows  a surface  that  was  generated  using  their 

bivariate  form.  The  controlling  points  for  the  surface  are 
shown  by  the  control  net  In  the  same  figure. 

Interpolating  Spl Ines. 

E.  Catmull  and  R.  Rom  have  described  a method  for 
getting  Interpolating  splines  with  a local  basis 

formu I at  ion  [14] . The  form  of  the  basis  functions  for 

interpolating  splines  can  be  obtained  in  a way  similar  to  the 
B-epline  development  above. 

Suppose  we  have  a sequence  of  points,  v0,  v„,  that 

we  wieh  to  fit  with  a piecewise  cubic  curve  that  is  of  the  form 

Pn(s)  » f e ( S)  V„  + fj(s)  Vi,n  + f 2 ( s ) Vj,n 

+ f a C s)  v3.„.  (2.12) 

If  we  impose  the  constraints 


Figure  2.8  Control  Point  Array  and  Generated  Biquadratic 

B-spline  Surface. 
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Pn(E)  - V l»nt 

P„(l)  - v2,„,  (2.13) 

P'„(0)  - c(v2,n  - vn) , 

P nd)  • c(v >n  ■ V l*n)  v 

where  c is  a positive  constant,  we  find  that  the  basis 
functions  ars  determined  to  be 


f e(e)  - c (-s3  + 2sz  - s) , 
fi(s)  - (2-c)s3  + (c— 3)  s2  + 1, 
f2(s)  - f i (l-s) , 
f 3( a)  » feCl-s) . 


(2.14) 


The  remaining  parameter,  c,  can  be  adjusted  to  control  the 
magnitude  of  the  tangent  of  the  curve  at  ite  ends.  The  value 
c-1/2  was  arbitrarily  chosen  for  all  of  the  work  described  in 
this  thesis.  Housver,  this  remaining  parameter  might  be 
adjusted  to  improve  the  subjective  "goodness  of  fit". 

As  with  B-9piines,  the  bivariate  form  for  these  functions 
is  obtained  by  using  the  tensor  product  of  the  univariate  basis 


funct i one. 


I 
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II. 4 Computation  Algorithms  for  Basis  type  splines. 

The  surface  formulation  for  both  the  B-splines  and  the 
interpolating  splines  discussed  in  section  II. 3 is,  for  cubice, 
of  the  form 

3 

S„.n(s,t)  - ^ Ms.t)  v, (2.15) 

i.i  = 0 


4 

i 


,1 

i 


It  is  interesting  to  look  at  the  number  of  computations 
required  to  find  a point  on  the  surface.  He  choose  a 
particular  value  for  s and  t,  evaluate  the  sixteen  bicubic 
functions  fJV(s,t)  for  this  choice  of  s and  t,  and  perform  the 
sum  over  j and  k from  0 to  3.  Each  part  of  the  3um  involves  3 
multiplies,  one  for  each  coordinate.  In  addition,  each  point 
influences  the  shape  of  IB  different  surface  patches  S»,n. 
Therefore,  each  time  a point’s  coordinates  are  changed,  the 
above  computations  must  be  performed  IB  times  for  each  value  of 
a and  t at  which  the  surface  is  to  be  evaluated. 


One  of  the  goals  of-  the  system  described  in  this  thesis 
was  to  be  able  to  update  the  surface  in  1/20  second  or  less 
when  a control  point  is  moved.  Obviously  this  goal  cannot  be 
met  if  the  number  of  computations  cannot  be  reduced  from  the 


number  mentioned  above. 


- --Amm . JIl-iSL 
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Since  the  graphical  equipment  used  in  this  system  is 
capable  of  drawing  only  straight  line  segments,  a parametric 
line  on  a surface  patch  is  drawn  as  a sequence  of  straight  line 
segments.  The  number  of  straight  line  segments  per  parametric 
line  and  the  number  of  parametric  lines  per  patch  determine  the 
number  of  points  at  which  the  surface  equation  must  be 
evaluated. 


The  first  step  in  reducing  the  arithmetic  in  the 
computations  is  to  choose  appropriate  intervals  for  values  of 
the  parameters  s and  t and  form  a table  of  precomputed  values 
for  each  of  the  1G  basis  functions.  If  for  exampla  we  choose 
intervals  of  1/5  for  s and  t,  then  a table  of  3G  values  for 
each  function  is  generated,  corresponding  to  these  values  of  s 
and  t.  We  can  then  do  a table  lookup  instead  of  evaluating  the 
funct i on. 


The  next  step  in  reducing  the  arithmetic  is  to  make  use  of 
the  local  character  of  the  approximations  that  the  basis 
splines  give.  A given  point  influences  only  a limited  part  of 
the  surface’s  shape.  Thus,  for  a particular  choice  of 
parameter  intervale  for  the  basis  functions,  the  surface  can  be 
completely  evaluated  at  initialization  time  and  stored  in 
tablular  form.  When  a point  is  moved,  only  those  patches  it 
Influences  need  to  be  altered.  For  the  parameter  spacing 


'7 


mentioned  above,  this  means  that  30*3  storage  locations  are 
needed  for  each  patch. 


The  final  reduction  in  arithmatic  is  obvious  when  we 
recognize  that  a movement  of  one  point  causes  only  one  of  the 
terme  In  (2.15)  to  change.  That  is,  if  point  (q,r)  is  changed 
by  AVqr,  then  the  surface  changes  by 


ASq-J  ,r-U  ( 9 , t ) ■ f (S,  t)  Av*q,r, 


(2.1G) 


for  j,k-0,l,2,3. 


1 


Thus  for  the  parameter  spacing  mentioned  above,  if  a point 
is  moved,  1G  patches  must  be  updated.  A minimum  of  30  points 
on  each  must  be  re-evaluatsd.  (We  can  omit  one  boundary 
parametric  line  per  patch  since  it  would  be  evaluated  twice.) 
Each  of  these  evaluations  involvss  3 multiplies  and  3 adds,  one 
for  each  coordinate.  Thue  1440  multiplies  and  1440  adds  must 
be  performed.  The  PDP-10  instruction  time  required  for  this 
number  of  operations  is  approximately  25  milliseconds.  This  is 
well  uithln  the  50  millisecond  requirement  mentioned  above. 
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1 1.5  Why  Use  B-sp lines? 

In  the  previous  sections  of  this  chapter,  the  essential 
points  of  most  of  the  major  mathematical  representations  that 
are  in  use  in  CAD  systems  today  ware  discussed.  B-splines  were 
chosen  for  the  major  mathematical  formulation  in  this  work. 

From  Section  1 1. 2 and  from  the  form  of  (2.1),  we  see  that 
the  Coons  patch  is  the  most  general  formulation  of  those 
discussed.  The  boundary  functions  Q(i,v),  Q(u,j),  QJi.v)  and 
Qv(u,j)  may  be  any  parametric  functions.  For  example,  the 
space  curves  might  be  semi-circles  or  parts  of  a complex 
molding.  This  flexibility  makes  the  Coons  formulation 
preferable  in  cases  in  which  this  type  of  flexibility  is 
needed.  With  Bfizier  and  B-spline  approaches,  this  level  of 
generality  is  not  readily  available. 

The  principal  disadvantage  of  the  Coons  approach  is  that 
the  twist  vector  terms  in  (2.1)  present  problems  to  people  who 
are  not  familiar  with  cross  partial  derivatives.  Even  for 
those  who  are  familiar  with  this  concept,  it  is  not  usually  an 
Intuitive  one  as,  for  example,  tangent  or  curvature  continuity 
is.  In  the  Bfizier  and  B-spline  formulations,  this  twist  vector 
concept  is  imbedded  implicitly  in  the  formulation. 
Consequently,  they  are  easier  formulations  to  use  in  many 
applications. 


■ 
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For  the  purposes  of  this  system,  another  discouraging 
feature  of  the  Coons  approach  is  that  the  interior  region  of  a 
Coons  patch  is  determined  solely  by  the  shapes  of  the 
boundaries.  Of  course,  the  form  of  the  functions  in  (2.2) 
influences  the  interior  shape,  but  these  functions  are  fixed 
for  ali  boundaries.  Ulth  the  B-spline  formulation,  the  user 
has  control  points  in  the  interior  of  the  patch  as  we  I I . These 
control  points  may  also  influence  the  shape  of  the  boundary 
curves. 

B-splines  and  Bfizier  surfaces  are  both  formulated  in  terms 
of  basis  functions.  However,  the  BSzier  basis  is  global,  and 
the  degree  of  the  basis  functions  varies  with  the  number  of 
points  being  approximated.  With  B-splines,  once  the  degree  of 
continuity  in  the  surface  is  specified,  the  basis  functions  are 
fixed  in  degree.  It  is  a local  approximation.  The  amount  a 
given  point  influences  the  surface  is  limited  in  extent  by  the 
weight  of  its  basis  function.  For  the  purposes  of  the 
free-form  goals  in  this  work,  this  feature  was  considered 
desirable. 

Another  reason  that  B-splines  are  preferred  over  the 
others  is  that  B-spline  surface  patches  are  automatically 
continuous  with  adjacent  patches.  This  is  true  if  they  share 
boundary  points,  and  It  I s an  intrinsic  property  of  the  local 
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basis  approach.  With  both  Coons  and  B§zier  patches,  the 
continuity  between  patches  is  explicitly  dealt  with  by  matching 
tangent  voctors,  or  tangent  boundary  functions,  at  the 
boundaries  of  the  patches.  Of  course  this  is  implicitly  what 
we  do  with  B-spllnes  when  we  cause  adjacent  patches  to  share 
boundary  points,  but  it  is  less  distracting  to  deal  with  points 
than  with  relative  vectors. 

When  a control  point  of  a B-spline  surface  is  moved,  its 
Influence  on  the  surface  is  local,  and  moving  it  does  not  alter 
the  continuity.  This  is  not  true  of  the  other  approaches. 

All  of  the  advantages  of  B-splines  discussed  to  this  point 
ate  a I so  shared  by  the  Catmul l-Rom(CR)  interpolating  splines 
discussed  before.  Actually,  these  functions  might  be 
considered  preferable  to  B-splines  because  they  interpolate. 
However,  there  is  a very  important  property  that  B-splines  have 
that  is  not  shared  with  the  CR  splines.  A B-spline  curve 
always  lies  within  the  convex  hull  of  the  points  it  is 
approximating.  The  convex  hull  for  a cubic  curve  is  shown  in 
Figure  2.9,  The  reason  for  thi3  property  is  that  the  B-spline 
curve  Is  a weighted  average  of  the  vertex  coordinates  with  the 
basis  functions  as  weights.  Since  the  basis  functions  are 
always  less  than  unity  and  are  positive  for  all  values  of  the 
parameter,  the  curve  lies  Inside  their  convex  hull. 


Figure  2.9  Convex  Hull  for  a Cubic  B-spline  Curve 


CHAPTER  III 


THE  3-0  B-SPLINE  DESIGN  SYSTEM 

III.l  System  Hardware  Configuration 

Figure  3.1  shows  the  hardware  configuration  for  the  design 
system.  The  main  computing  engine  for  the  system  is  the  PDP-10 
computer.  This  machine  controls  the  operation  of  the  rest  of 
the  system. During  normal  operation,  the  PDP-10  program  stays  in 
a loop  in  which  it  reads  the  counter  values  for  the  head 
position  and  wand  position,  the  function  switches  and  the  wand 
buttons.  This  is  done  through  the  PDP-10  I/O  Buss  interface. 
From  these  counter  vaiues,  the  main  program  computes  the 
separate  matrices  that  make  up  the  head  position  matrix  and 
finds  the  wand  position.  Then  if  any  changes  must  be  made  to 
the  surface,  the  incremental  computation  is  done,  and  the 
display  file  for  the  display  processor  is  updated. 

The  secondary  computer  in  the  system  is  the  LD3-1  display 
processor.  This  machine’s  only  task  is  to  generate  the 
composite  viewing  transformation  and  execute  the  drawing 
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instructions  in  the  display  file.  It  has  access  to  the  main 
memory  via  the  PDP-10  Memory  Buss.  Figure  3.2  ie  a picture  of 
the  display  processor  and  I/O  Buss  interface  equipment. 

When  the  uork  described  in  th i b thesie  first  began,  the 
system  as  shoun  In  Figure  3.1  did  not  exist.  There  were  two 
principal  components  missings  the  Matrix  Multiplier  and  the 
Clipping  Divider.  In  addition,  the  display  processor,  the 
counter  logic  and  the  line  generator  did  not  work  properly. 
The  Matrix  Multiplier  was  purchased  from  Systems  Concepts,  and 
the  Clipping  Divider  was  designed  and  built  at  the  University 
of  Utah  [153.  When  both  of  these  devices  were  operational,  the 
rest  of  the  system  was  repaired. 

1 1 1.2  The  3-D  Environment 
Head-Mounted  Display. 

The  principal  hardware  component  of  the  3-D  environment  is 
the  head-mounted  display.  This  display  was  the  first  of  its 
kind  ever  to  be  built.  As  mentioned  before,  it  was  brought  to 
the  University  of  Utah  when  Ivan  Sutherland  joined  the  faculty 


here  In  19G8. 
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Figure  3.2  Picture  of  Display  Hardware,  including  counter 
logi  and  10  and  Memory  Buss  Interfaces. 


Figure  3.3  Is  a picture  ot  the  head-mounted  display,  which 
provides  the  three-dimensional  display  environment.  The 
mechanism  of  the  head-mounted  display  permits  the  computer  to 
sense  the  position  of  the  observer  in  the  room  and  the  angular 
attitude  of  his  head.  Consequently,  the  computer  "knows"  what 
the  observer  ought  to  be  able  to  see  and  presents  the 
appropriate  scene  on  two  miniature  CRT’s,  one  for  each  of  the 
observer’s  eyes.  If  there  is  a three-dimensional  object 
defined  "in"  the  computer,  the  observer  can  see  it,  walk  around 
it,  move  closer  or  farther  away,  or  even  walk  through  it. 

The  display  uses  six  shaft  encoders  to  measure  the 
independent  quantities  needed  to  determine  the  six  degrees  of 
freedom  that  one  rigid  body  has  relative  to  another.  The  six 
quantities  determine  the  orientation  of  the  viewing  part  of  the 
head-mounted  display  relative  to  the  room.  There  are  five 
angular  measurements  and  one  displacement  measurement.  The 
first  of  these  determines  the  angle  of  rotation  of  the  entire 
display  mechanism  relative  to  the  roomlsee  Figure  3.4).  The 
next  two  are  the  angles  of  rotation  about  the  axes  of  a 
universal  joint,  which  is  located  at  the  top  of  the  room.  Then 
the  displacement  measurement  i3  made  from  the  universal  joint 
at  the  top  of  the  room  to  one  located  just  above  the  viewing 
mechanism.  The  last  two  measurements  are  the  angles  in  the 
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lower  universal  joint.  A more  detailed  description  with  the 
appropriate  transformation  matrices  shown  is  given  in 
Appendix  1. 


When  the  system  is  first  initialized,  the  head-mounted 
dieplay  is  placed  in  a calibration  stand.  The  counters  for  the 
e i x shaft  encoders  are  then  preset  to  the  calibration  values 
that  fix  the  location  of  the  origin  of  the  room-fixed 
coordinate  system  relative  to  the  CRT  headset.  Movements  of 
the  display  mechanism  cause  the  shaft  encoders  to  send  pulses 
to  their  respective  counters  causing  them  to  count  up  or  down. 
The  counters  are  triggered  whenever  a pulse  comes  from  the 
shaft  encoders.  The  counter  values  are  read  by  the  main  PDP-10 
progranr  each  time  the  head  position  matrix  is  to  be  calculated. 
The  values  are  then  used  to  compute  the  matrices,  which  are 
combined  by  the  matrix  multiplier  to  form  the  head  position 

matrix.  Details  of  these  computations  are  given  in  Appendix  1. 

I 

3-0  Wand. 

A substantial  effort  has  been  made  at  the  University  of 
Utah  to  build  a good,  real-time,  3-D  digitizer  that  has  no 
mechanical  constraints.  One  such  effort  has  been  an  attempt  by 
several  students  to  build  an  acoustical  digitizer,  or  3-D 
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tablet,  using  a method  like  that  used  in  the  SAC  Tablet [IB]. 
Three  very  long  cylindrical  microphones  were  mounted  along 
mutually  perpendicular  axes,  and  the  appropriate  electronics 
uere  used  to  find  the  3-0  coordinates  of  the  SAC  spark  pen. 
Because  of  the  difficulty  and  expense  in  maintaining  the 
microphones,  this  project  was  abandoned. 


The  most  recent  3-0  digitizer  attempt  made  at  the 
Unlvereity  of  Utah  was  the  Burton  Box  by  Robert  Burton [17] . 
This  system  consisted  of  4 rotating  disks  with  small  radial 
silts  cut  in  them.  Behind  each  disk  were  two  photomultiplier 
tubee  and  an  optical  system.  As  the  disks  rotated,  a light 
emitting  diode  (LED)  was  very  briefly  turned  on.  The  LED  and 
the  slit  that  passed  in  front  of  the  photomultiplier  define  a 
Plane  containing  the  LEO.  If  the  LED  is  "visible"  by  all  of 
the  photomul tipi iere,  then  the  system  simultaneously  solves  8 
Planar  equations  for  an  intersection  point.  This  point 
represents  the  location  of  the  LED. 


The  problems  with  this  system  were  numerous.  The  wors 
problem  Mas  that  the  standard  deviation  of  the  3-D  coordinate! 
of  a etationarg  LED  Mas  7 mi  I I. meters.  Stated  in  other  terms, 
one  out  of  every  100  samplings  of  the  coordinates  of  the  poinl 
Mould  be  outside  of  the  radius  of  a ping-pong  ball.  Another 
annoying  problem  uith  the  Burton  Bov  uas  that  it  could  not  be 
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in  operation  for  more  than  30  minutes  at  a time  due  to  excess 
heat  generated  by  the  motors  that  were  rotating  the  disks. 
Thle  heat  caused  the  photomultiplier  outputs  to  be  excessively 
noi sy. 

Much  has  been  laarned  about  the  3-D  digitization  problem 
through  the  efforts  described  above.  I believe  that  an 
approach  that  utilizes  some  of  the  ideas  in  Burton’s  thesis 
will  lead  to  a system  that  can  accurately  determine  3-D 
coordinates  in  real-time.  A possible  system  that  accomplishes 
thie  ie  proposed  in  Appendix  2. 

The  only  reliable  3-D  uand  to  be  built  at  the  University 
of  Utah  i 8 based  on  a mechanical  position  sensing  mechanism. 
In  thie  device,  the  wand  position  is  found  by  measuring  the 
lengths  of  3 wires  attached  to  a point  on  the  handle  of  the 
wand  and  extending  to  three  housings  mounted  on  the  ceiling. 
The  housings  are  located  at  the  corners  of  an  isoceles 
triangle.  Inside  each  housing  is  a drum  around  which  the  wire 
i e wrapped,  a negator-spr i ng  motor,  and  a shaft  encoder.  The 
ehaft  encoder  records  the  anguiar  displacement  of  the  drum,  and 
from  this  measurement  the  amount  of  wire  extending  from  the 
housing  is  determined.  The  purpose  of  the  spring  motor  is  to 
maintain  a constant  tension  in  the  wire  for  varying  lengths. 
The  wand  position  is  computed  from  the  intersection  of  three 
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spheres  with  centers  at  the  three  housings  and  radii  equal  to 
the  lengths  of  wire.  The  details  of  the  computation  will  be 
found  in  Appendix  1. 

Di splay  Equipment. 

The  line  drawing  display  equipment  used  in  this  system  is 
bu I It  around  the  Evans  and  Sutherland  LDS-1  display  processor. 
This  processor  is  a special  purpose  computer  that  has  access  to 
the  PDP-10  storage  by  way  of  the  Memory  Buss (see  Figure  3.1). 
The  processor-to-processor  communication  takes  place  over  the 
PDP-10  I/O  Buss. 

The  LDS-1  processor  is  initialized  by  commands  issued  over 
the  I/O  buss  by  the  controlling  PDP-10  program. These  commands 
initialize  various  configuration  and  status  registers  in  the 
processor,  Matrix  Multiplier,  and  Clipping  Divider.  Then  a 
command  is  issued  to  start  the  processor  at  a certain  storage 
location,  and  the  LDS-1  begins  executing  the  display  program. 

A I I drawing  commands  and  pipeline  device  commands  for  the 
Matrix  Multiplier  and  Clipping  Divider  are  passed  on  to  the 
command  pipeline.  If  the  command  is  to  draw  a line,  the  Matrix 
Multiplier  transforms  the  endpoints  of  the  line  into  the 
viewing  coordinate  system  and  passes  it  on  to  the  Clipping 
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Divider.  The  Clipping  Divider  then  clips  the  line  to  the 
pyramid  of  vieion,  thereby  eliminating  part  or  all  of  the  line, 
and  performs  the  perspective  division  on  the  endpoints  of  the 
clipped  line.  The  resulting  line  is  scaled  to  scope 
coordinates  and  given  to  the  line  generator,  which  generates 
the  analog  ramps  for  beam  deflection  and  sends  them  to  the 
deflection  electronics  for  the  scope. 

This  LDS-1  Display  Processor  is  a very  powerful  device.  A 
number  of  its  features  have  made  the  implementation  of  this 
system  much  easier.  Probably  its  most  inportant  feature  is 
that  it  is  a processor  and  it  executes  its  own  program.  This 
means  that  it  can  interrogate  memory  locations  and  has  its  own 
instruction  set.  Sines  the  LDS-1  instruction  word  has  the  same 
boundaries  as  the  PDP-10  instruction  word,  it  can  be  programmed 
by  making  CPDEFS  in  the  MACRO10  Assembler.  It  also  has  a stack 
and  subroutire  capability. 

Another  useful  feature  of  this  display  system  is  that  the 
Matrix  Multiplier  can  multiply  matrices  together.  For  example, 
In  finding  the  viewing  transformation  matrix  each  frame,  the 
PDP-10  program  generates  8 matrices  and  the  Matrix  Multiplier 
combines  these  separate  transformations  to  form  the  composite 
viewing  transformation. 


I II. 3 Communication  with  the  System. 


AM  communication  with  ths  basis  spline  design  system  is 
through  a set  of  flvs  buttons  on  the  handle  of  the  wand  (see 
Figure  3.5),  a panel  of  18  switchss,  and  the  teletype.  When 
the  system  is  initialized,  it  allows  the  user  to  select  a file 
to  start  the  design.  These  files  are  stored  on  DECTAPE.  The 
file  selected  is  read  into  storage  and  the  corresponding 
surface  Is  created  and  entered  in  the  display  file.  The  user 
can  then  interact  with  the  surface  by  moving  the  control 
points.  Interaction  with  the  surface  in  this  system  consists 
of  free,  i.e.  unrestricted  and  unconstrained,  movements  of  the 
control  points.  After  completing  some  stage  of  the  Jesign, 
intermediate  results  of  the  design  can  be  saved,  and  the  use,'' 
may  continue  designing 

System  Features. 

A number  of  features  were  added  to  the  first  version  to 
make  it  easier  to  design  objscts  with  the  system.  Since  the 
objects  designed  with  this  system  might  be  larger  than  the 
space  defined  by  the  limits  of  the  mechanical  head  position 
sensors,  the  ability  to  rotate  and  translate  the  object  was 
added.  This  is  done  by  selecting  the  appropriate  switch  on  the 
switch  console.  The  first  two  buttons  on  the  wand  are  then 
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treated  as  a two  bit  speed  control.  The  switch  on  the  back  of 
the  handle  Is  used  to  reverse  direction.  The  object  is  rotated 
or  translated  by  making  the  appropriate  changes  to  its 
transformation  matrix  rather  than  by  changing  the  data. 

In  normal  operation,  the  system  displays  only 
Isoparametric  curves (rendered  as  collections  of  straight  line 
segments)  in  the  surface  and  emphasized  dots  to  represent  the 
control  points.  Figure  3.S  shows  some  typical  views  as  seen  on 
the  display.  As  control  points  are  moved,  the  appropriate 
surface  patches  are  updated  in  real-time.  This  gives  the  user 
immediate  feedback  on  the  shape  of  the  object.  The  control  net 
ie  not  displayed  because  there  would  then  be  too  much  detail 
being  displayed,  and  the  object  would  be  difficult  to  see. 
However,  since  the  user  is  allowed  to  move  the  control  points 
freely,  it  occasionally  happens  that  the  connectivity  of  the 
control  points  becomes  confusing.  In  these  cases,  it  is  almost 
eesentlal  to  have  the  control  net  displayed.  Therefore  another 
switch  was  added  that  allows  the  user  to  select  either  the 
control  net  or  the  surface  to  be  displayed. 

In  order  to  be  able  to  update  the  surface  in  real-time,  a 
special  computation  algorithm  had  to  be  used.  The  details  of 
thie  algorithm  were  discussed  in  Section  1 1. 4.  Since  the  LDS-1 
uses  fixed  point  arithmetic,  this  algorithm  suffers  from 
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round-off  problems.  As  a result  of  accumulated  ruund-off 
errors,  the  part  of  the  surface  influenced  by  a given  point 
begins  to  look  ragged  after  the  point  has  been  moved  around  a 
lot.  When  the  surface  begins  to  look  too  ragged,  the  user  can 
cause  the  surface  to  be  completely  computed  over  again  by 
pressing  one  of  the  wand  buttons.  This  computation  usually 
takee  from  2 to  5 seconds  of  computer  time. 

To  keep  the  POP-10  loop  under  50  milliseconds  a' I of  the 
time,  a special  searching  method  is  employed  to  find  when  the 
wand  is  close  enough  to  a point  to  grasp  it.  A search  through 
the  complete  set  of  control  points  is  per.formed  only  in  two 
cases:  1)  if  both  buttons  1 and  2 on  the  wand  are  pressed  or  2) 
if  the  wand  is  not  already  grasping  a point.  In  this  way,  the 
main  program  does  not  usually  have  to  both  find  which  point (s) 
the  wand  is  near  and  also  update  the  surface  for  the  point (s) 
being  moved.  The  only  case  for  which  the  update  must  be  done 
while  searching  for  points  is  when  both  buttons  1 and  2 are 
pressed.  This  exception  allows  the  user  get  additional  points 
while  also  holding  onto  those  he  has. 

Another  special  case  arises  when  the  user  decides  he  wants 
to  separate  two(or  more)  points  that  he  has  merged  together. 
To  allow  this  kind  of  control,  button  1 is  used  to  grasp  only  1 
point  at  a time,  and  button  2 is  used  to  get  more 
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than  one  point. 

Human  Factors. 

Several  problems  have  been  encountered  by  the  people  uho 
have  used  this  system.  The  most  annoying  of  these  problems  is 
that  the  ulres  for  the  uand  get  tangled  in  the  position  sensing 
mechanism  for  the  head-mounted  display.  This  makes  it 
difficult  to  maneuver  around  in  the  room  as  freely  as  one  would 
like.  Another  problem  is  that  it  is  not  easy  to  attach  the 
viewing  portion  of  the  head-mounted  display  to  the  head.  This 
ie  because  of  th9  tone  I on  in  the  mechanical  position  sensing 
mechanism.  The  user  must  hold  onto  the  head  position  sensing 
mechanism  with  one  hand  and  onto  the  uand  uith  the  other. 
These  difficulties  in  using  the  system  uere  accepted  since  to 
improve  the  situation  ue  would  have  to  improve  the  sensing 
mechanism  and  perhaps  make  it  non-mechanical,  uhich  is  a 
complete  problem  In  itself. 

An  interesting  problem  arises  uhen  ue  try  to  use  the  uand 
to  grasp  a point  In  the  room.  Uhen  the  first  version  of  the 
system  was  written,  the  uand  was  displayed  as  a small  cube 
about  3/4  inch  per  side,  and  the  control  points  for  the  surface 
uere  displayed  as  dots.  To  grasp  a point,  the  user  had  to 
manipulate  the  uand  until  one  of  the  control  points  was  inside 
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the  cube  and  cnen  press  a button  on  the  wand  handle. 

Alternately,  he  could  first  press  the  button  and  then  search 
for  the  point.  This  was  done  by  holding  the  wand  so  that,  from 

the  user  point  of  view,  the  point  was  inside  the  boundaries  of 

the  cube  on  the  diplay,  then  moving  the  wand  forward  and 
barkward  until  the  depth  of  the  point  was  found.  This 

procedure  proved  to  be  very  tiresome. 


The  first  change  to  this  procedure  was  to  draw  a cross 
hair  inside  the  cursor  cube  that  is  about  four  times  the  size 
of  the  cube.  As  a que  that  the  wand  is  close  to  a point,  when 
the  wand  gets  less  than  4 inches  from  any  point,  the  cross  hair 
decreases  In  size  as  the  Manhattan  distance  (that  is  the 
rectangular  distance)  to  the  closest  point  decreases.  This 
addition  makes  it  much  easier  to  find  a point  with  the  wand. 

One  final  improvement  that  was  made  was  to  draw  a line 
from  the  center  of  the  cursor  cube  to  the  nearest  point  uhen 
the  cursor  is  Ies3  than  five  inches  from  any  point.  This 
provides  additional  aid  in  finding  the  depth  of  the  point. 

A number  of  improvements  in  this  aspect  of  the  system  have 
been  suggested  by  people  who  have  used  the  system.  One  of  the 
best  suggestions  was  to  use  the  wand  as  an  aiming  device.  Used 
in  this  way,  the  wand  can  make  relative  movements  to  points  by 
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aiming  at  the  point  and  grasping-at-a-di stance  when  a button  is 
preesed.  Another  suggestion  was  to  display  the  control  points 
as  small  cubes  rather  than  dots,  thereby  giving  a good  depth 
cue  with  the  display  of  the  point.  Another  was  to  display  the 
environment  in  stereo.  All  of  these  suggestions  seem  to  be 
reasonable  attempts  at  solving  the  problems  of  finding  a 
control  point  with  the  wand.  However,  improvements  of  this 
eort  come  from  an  endless  source,  and  none  of  them  attack:  the 
real  problem.  The  real  problem  is  that  one  needs  a multiple 
point  wand  and  more  freedom  to  move  about  in  the  3-D 
environment  than  this  system  will  allow  because  of  the 
mechanical  poeition  sensing  mechanisms. 

Off-line  Shaded  Pictures. 

AM  of  the  surfaces  in  this  system  were  rendered  by 
drawing  some  of  the  parametric  lines  in  the  surface  patches. 
No  attempt  was  made  to  remove  any  hidden  parts  of  the  surfaces 
or  provide  any  type  of  shading.  The  reason  that  the  surfaces 
uere  rendered  in  this  fashion  is  that  smooth  shaded  hidden 
eurface  algorithms  take  too  long  to  compute  to  be  useful  in  a 
real-time  system.  (Actually,  with  enough  hardware,  this  could 
be  done  in  real-time.  Shaded  picture  systems  exist  that 
provide  this  type  of  response £18] . ) Nonetheless,  a mechanism 
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hae  been  provided  that  al  Iowb  the  user  to  record  a design 
sequence  in  real-time  and  reconstruct  the  sequence  in  a 
smooth-shaded,  halftone  picture  movie. 


An  interrupt  service  routine  uas  incorporated  in  the 
design  system  as  a selectable  feature.  Each  1/12  second,  both 
the  head  position  transformation  matrix  and  all  incremental 
changes  to  the  coordinates  of  control  points  tha4  have  taken 
place  since  the  last  frame  are  written  on  disk.  Another  set  of 
programs  that  uses  tha  Watkins  hardware  then  uses  this 
information  to  create  a halftone  movie.  Figure  3.7  is  a 
halftone  picture  of  a Klein  bottle  generated  by  this  process. 
Several  sequences  have  been  recorded  in  this  fashion,  including 
a walk  through  a Klein  bottle.  These  sequences  and  several 
live  action  sequences,  which  were  taken  from  the  face  of  the 
CRT  during  a design  sequence,  have  been  submitted  as  part  of 
th i s thes i s [191 . 
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igure  3.7  Halftone  picture  of  the  Klein  bottle  produced  w 1 th  the  system 
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□ .AFTER  IV 

CONCLUSION  AND  SUMMARY 
IV. 1 System  Evaluation. 

The  syetem  described  in  this  thesis  is  an  experiment  in 
the  feasibility  of  3-D  surface  design  in  a three-dimensional 
environment.  The  B-spline  surface  formulation  was  chosen  to 
represent  the  surfaces  for  the  reasons  given  in  Section  III. 5. 

One  of  the  premises  of  this  work  is  that  3-D  design  should 
be  done  In  a 3-D  environment.  To  design  3-D  objects  using  2-D 
perspective  projections  and  2-D  input  devices  unnecessarily 
constrains  the  user.  Generally,  those  who  have  used  this 
syetem  agree  that  it  is  much  more  convenient  to  have  a 3-D 
input  device  and  to  manipulate  the  objects  in  a 3-D  environment 
than  with  other  kinds  of  systems.  However,  because  the 
manipulation  is  totally  unrestricted  and  unconstrained,  it 
would  be  difficult  to  use  this  system  as  it  currently  is 
Implemented  to  design  something  that  must  satisfy  physical 
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There  are  several  very  important  features  that  are 
required  before  a 3-D  surface  design  system  becomes  useful  in 
this  sense.  The  first  and  most  important  is  the  ability  to 
constrain  the  geometry  of  the  surface  to  certain  shapes.  As 
the  system  now  exists,  the  ueer  may  grasp  any  control  point  and 
mjve  it  to  any  place  in  the  operating  environment.  Movement  of 
this  point  does  not  influence  the  position  of  any  other  point. 
Experience  has  shown  that  this  Is  often  too  much  freedom. 

The  type  of  restriction  we  might  like  to  impose  on  the 
design  is  that  a group  of  the  points  making  up  an  object  always 
lie  in  a plane.  Then  if  several  of  the  points  in  the  group  are 
moved,  the  others  might  be  moved  by  the  program  to  maintain  the 
planar  constraint. 

Another  obvious  feature  that  should  be  added  is  the 
ability  to  specify  planes  of  reflection  for  objects  being 
deeigned.  Objects  are  often  symmetric  about  at  least  one 
plane,  e.g.  cars,  aircraft,  etc.  If  the  system  is  capable  of 
generating  the  mirror  image,  then  by  manipulating  one  side,  the 
program  can  modify  the  other  symmetrically. 

A viable  system  should  also  be  able  to  handle  complex 
geometries.  Because  of  the  rectangular  mesh  in  a tensor 
product  surface,  it  is  not  clear  that  the  tensor  product  form 
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of  B-eplinee  alone  is  sufficient  to  handle  these  complex 
requirements.  The  simple  tensor  product,  e.g.  bicubic,  basis 
is  certainly  not  sufficient  to  handle  cases  in  which  the 
surface  must  join  to  a boundary  of  predefined  shape.  Some 
combination  of  B-splines  with  a blending  function  method  like 
the  Coons  method  is  probably  the  correct  way  to  handle  this 
special  case [20J. 

A drawback  of  this  system  that  many  people  seem  to  be  able 
to  accept  is  the  limitations  of  the  mechanical  position  sensors 
for  the  wand  and  head  mounted  display.  From  Figure  3.3  we  can 
see  the  mechanical  linkage  for  the  head  mounted  display 
extending  up  to  the  ceiling.  The  three  housings  for  the  wand 
can  a I so  be  seen  in  the  picture.  Each  of  the  wand  housings  has 
a wire  extending  to  the  wand  handle.  These  wires  and  the  head 
mounted  display  linkage  intefere  with  each  other  considerably. 

A really  good  real-time  30  digitizer  that  can  find  the  3-D 
coordinates  of  10  or  more  points  in  real-time  would  alleviate 
this  difficulty.  If  we  could  mount  3 or  more  LED’s  on  a helr.nt 
and  determine  their  3-D  coordinates  in  real-time,  we  could  use 
this  information  to  find  the  orientation  of  the  helmet  in  the 
room.  In  other  words,  we  could  eliminate  the  mechanical 
linkage  shown  in  Figure  3.3. 
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Also,  with  such  a device  we  could  attach  LED’s  to  the  ends 
of  the  thumb  and  index  and  middle  fingers  of  each  hand.  Then 
we  could  grasp  a point  by  bringing  the  thumb  and  index  finger 
to  close  on  i t tl7] . 

IV. 2 Other  Uses  for  the  Head  Mounted  Display. 

The  head  mounted  display  was  used  in  this  system  to  view 
the  surfaces  being  designed  in  three  dimensions.  However, 
there  are  several  other  uses  for  such  a combination  of  position 
sensors  as  that  used  to  sense  the  head  position.  One  such  use 
is  to  describe  a "path"  of  a rigid  object  through  space.  For 
example,  suppose  we  want  to  record  a sequence  of  positions 
(orientation  and  displacement)  for  an  airplane  to  follow  in  an 
animated  film.  Describing  such  paths  is  a very  tedious  task  in 
computer  animation.  But  this  position  sensor  would  allow  us  to 
"fly"  the  display  mechanism  around  the  room,  recording  its 
position  each  frame  time.  The  results  can  then  be  used  to 
position  the  aircraft  in  the  animated  film. 

A very  difficult  problem  in  3-D  computer  graphics  is 
creating  a 3-D  data  base  for  objects  to  be  displayed.  Clearly, 
the  head  mounted  display  sensing  mechanism  can  be  used  to  make 
measurements  of  this  type.  The  position  sensing  mechanism  used 


in  this  display  has  a precision  of  approximately  1/16  inch  at 
the  lower,  or  viewing,  snd.  To  use  i t as  a digitizer,  we  can 
attach  a sharp  point,  or  scribe,  to  the  viewing  mechanism  and 
calibrate  the  position  of  the  point.  Then  the  head  mounted 
dieplay  can  be  used  to  find  the  3-D  coordinates  of  a 9et  of 
points  on  the  object,  so  long  as  the  object  i9  large  enough 
that  the  1/1G  inch  precision  is  not  an  important  factor  in  the 
accuracy  of  ths  measurements. 


IV. 3 Lessons  in  Hardware. 


Ths  original  goal  of  this  work  was  to  build  a system  for 
designing  B-9pline  surfaces  in  a three  dimensional  environment. 
A sscondary  goal  ua9  to  utilize  the  head  mounted  display.  Both 
of  these  goals  required  that  a considerable  effort  go  into 
building  and  repairing  special  purpose  display  equipment. 


Ths  hardware  in  this  system  comes  from  a variety  of 
sources.  Ths  Clipping  Dividsr  was  designed  and  built  here  at 
the  Univereity  of  Utah,  and  the  Matrix  Multiplier  was  built  by 
Systsms  Concepts,  a 9pscial  purpose  hardware  company  in  San 
Francisco.  The  hsad  mounted  display  was  built  at  Harvard 
University  in  1967  when  Ivan  Sutherland  wa9  on  the  faculty 
there,  and  the  remainder  of  the  system  was  bu  1 1 by  various 
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etudent9  and  staff  at  the  University  of  Utah. 

A very  significant  problem  with  a hardware  system  of  the 
sort  used  to  implement  this  design  system  ie  the  difficulty  in 
maintaining  it.  Certainly  it  Is  possible  to  have  maintainence 
contracts  with  each  of  the  separata  vendors  for  the  equipment, 
but  how  does  one  isolate  uhlch  component  is  bad?  Either  one 
maintainence  engineer  should  be  responsible  for  maintaining  the 
whole  system,  or  at  least  ths  line  drawing  part  of  it  should  be 
purchased  from  one  manufacturer.  Then  that  one  company  can  be 
responsible  for  keeping  it  operational. 


„ an.'.  


REFERENCES 


li]  Coons,  S.  A.,  Surfaces  for  Computer-Ai ded  Design  of  Space 
Forms,  M.I.T.  Project  MAC  TR-41,  June  1SB7. 

[21  BAzier,  P.  I Numerical  Control  in  Automobile  Design 
and  Manufacti  of  Curved  Surfaces",  Curves  and  Surfaces 
In  Engineer  I r. 'jr  I.P.C.  Science  and  Technology  Press, 
Guildford,  England,  1972. 

[3]  Sabin,  M.  A.,  The  British  Aircraft  Corporation  Numerical 
Master  Geometry  System.  Proc.  Roy.  Soc.  Lond.  A321, 
197-205,  (1971). 

[41  Armit,  A.  P.,  Computer  Systems  for  Interactive  Design  of 
Three-Dimensional  Shapes,  Ph.D.  Thesis,  University  of 

Cambridge  Computer  Laboratory,  November,  1970. 

[53  Ferguson,  J. , "Mu 1 1 i variable  Curve  Interpolation",  Journal 
of  the  ACM,  Vo  1 . 11,  No.  2,  221-228,  April,  1974. 

[6]  Rieserfeld,  R.  F. , Applications  of  B-spline  Approximation 

to  Geometric  Problems  of  Computer  Aided  Design,  Ph.D. 
Thesis,  Syracuse  University,  1972.  Published  as 

University  of  Utah  UTEC-CSc-73-12G. 

[7]  Sutherland,  I.  E.,  "A  Head-Mounted  Three-Dimensional 
Display,"  AFIPS  Conference  Proceedings,  Vol.  33  (Fall 
Joint  Computer  Conference,  19G8)  pp.  757-7G4. 

(81  Forrest,  A.  R. , Computational  Geometry,  Proc.  Roy.  Soc. 
Lond.  A321 , pp.  189-195,  1971. 

(91  Gordon,  U.  J.  , and  Riesenfeld,  R.  F.,  Bernste i n-Bez i er 
Methods  for  the  Computer-Aided  Design  of  Free-Form  Curves 
and  Surfaces,  Journal  of  the  ACM,  Vol.  21,  No.  2. 
293-310,  April  1974. 

[10]  Forrest,  A.  R.  , On  Coons  and  Other  Methods  for  the 
Representation  of  Curved  Surfaces.  Computer  Graphics  and 
Image  Processing  1,  pp.  341-359  (1972). 

[11]  Bftzler,  P.E.,  "Procede  de  Definition  Numerique  des  Courbes 


64 


et  Surfaces  Non  Mathemat  i que,*  Systems  UNISURF.", 
Automat i erne  13,  (lay  1968. 

[121  S.  A.  Coone  gave  a seminar  at  the  University  of  Utah  in 
January  1972  in  which  he  discussed  the  B-spline  work  being 
carried  out  by  R.  F.  Riesenfeld  of  Syracuse  University. 

Cl 3]  Uatkins,  G.  S. , A Real-Time  Visible  Surface  Algorithm, 
Ph.D.  Thesis,  Uni versi ty  of  Utah,  1970. 

[14]  Catmull,  E.  and  Rom,  R.,  "A  Class  of  Local  Interpolating 
Splines",  Computer  Aided  Geometric  Design,  ed.  by  R.E. 
Barnhill  and  R.F.  Riesenfeld,  Academic  Press,  1975. 

[153  Blanchard,  (1.,  Clipping  Divider  documentation,  University 
of  Utah,  1974. 

[16]  SAC  Tablet  documentation,  Universtiy  of  Utah. 

[173  Burton,  R.  P.,  Real-time  Measurement  of  Multiple 
Three-Dimensional  Positions,  Ph.D.  Thesis,  University  of 
Utah,  1973. 

[18]  Case  Western  University  has  a halftone  picture  system, 
built  by  E and  S.  Computer  Company,  that  provides 
real-time  smooth-shaded  pictures  of  environments  with  up 
to  1500  polygons. 

[19]  Copies  of  this  movie  may  be  obtained  from  the  University 
of  Utah  Computer  Science  Library. 

[20]  Coons,  S.  A.,  'Surface  Patchss  and  B-spline  Curves", 
Computer  Aided  Geometric  Design,  ed.  by  R.E.  Barnhill 
and  R.F.  Riesenfeld,  Academic  Press,  1975. 

[21]  Peters,  G.J.,  Parametric  Bi-Cubic  Surfaces",  Computer 
Aided  Geometric  Design,  ed.  by  R.  E.  Barnhill  and  R. 
F.  Riesenfeld,  Academic  Press,  1975. 

[223  Catmull,  E. , Ph.D.  Thesis,  University  of  Utah,  1974. 


APPENDIX  1 


POSITION  DETECTION  COMPUTATIONS 

Al.l  Head-Mounted  Display  Computations. 

The  mechanical  position  ssnsor  for  the  head-mounted 
display  measures  ths  G independent  quantities  necessary  to 
determine  the  position  of  one  rigid  body,  the  display,  relative 
to  another,  the  room.  There  are  5 angular  measurements  and  1 
length  measursmsnt  (sss  Figure  3.4). 

Ths  first  angular  measurement  measures  the  rotation  of  the 
head-mounted  display  relative  to  ths  room.  The  coordinate 
system  attached  to  the  ceiling  is  labeled  (x,y,z).  The 
(xi* Ui* zi>  syetem  is  attached  to  ths  head-mounted  display.  If 
the  hsad-mountsd  display  is  rotated  in  the  sense  shown  in 
Figure  Al.l,  then  ths  matrix  shown  is  the  appropriate 
transformation  to  take  points  described  in  the  (y,x,z)  system 
to  points  described  in  the  (x,, y ,, r ,)  system. 

A I so  shown  in  Figure  Al.l  are  the  transformat  ions  for  the 
rotations  at  ths  upper  universal  joint.  The  first  of  these 
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rotations  is  a rotation  about  the  xi  axis,  and  the  second  is 
about  the  z z axis. 

The  next  transformation  uses  the  length  measurement  D. 
This  represents  a translation  along  the  y3  axis  Also  shown  is  a 
correction  rotation  about  the  y3  axis.  This  corrects  for  a 7 
degree  misalignment  betueen  the  axes  of  the  upper  and  iouer 
universal  joints. 

The  two  transformations  for  the  lower  universal  joint  are 
shown  next.  There  is  also  one  final  transformat i on  to  account 
for  the  translation  from  the  position  of  the  universal  joint  to 
the  position  of  the  eye. 

When  all  of  these  matrices  are  multiplied  together,  the 
room  to  eye  transformation  is  formed.  This  matrix  transforms 
polnte  described  in  the  left  hand  coordinate  system  at  the  top 
of  the  room  to  points  in  the  left  hand  coordinate  system  at  the 
eyeba I I . 


A1.2  Wand  Computations. 

The  wand  position  is  computed  from  the  lengths  of  wire 
extending  from  the  three  housings  that  enclose  the  shaft 
encoders.  Figure  A1.2  shows  the  coordinate  system  relative  to 
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which  the  computations  are  done.  The  eeneor  houeinge  are 
labeled  H„  H„  H„  and  the  dletancee  to  the  uand  are  r„  r;,  and 
r..  The  wand  poeition  la  found  from  the  Intersection  of  three 
spheres.  From  the  equation  of  a sphere  we  find: 

nz  - x2  + (y-di) 2 + zz, 
r2z  - (x-d)2  + y2  + z2, 
and  r32  - (x-d)2  + y2  + z2. 

Subtracting  the  r3  equation  from  the  rz  equation  we  obtain 
x . (rz2  - rz2)  / 4d. 


Then  siiminating  z from  the  first 


two  equations  we  get  for  y: 


y ■ ( rz2  - rz2  - 2dx  + 2d2  ) / 2d„ 


Then  z is  obtained  from  any  of  the  three  equations  using  the 

previously  computed  values  of  „ and  y.  Since  a square  root 

must  be  taken  In  any  case,  the  sign  is  negative  because  the 

wand  is  aluays  assumed  to  be  belou  the  plane  containing  the 
housings. 


{ 


Bliss  routines  to  find  the  head  position  matrix  and  the 
wand  position  ars  available  in  the  <GRAPHICS>  directory  at 
UTAH-10  under  file  name  HMOU.BLI. 


APPENDIX  2 

U-D  DIGITIZING  IN  REAL-TIME 

It  wa9  mentioned  in  Chapter  4 that  a real-time  multi-point 
3-D  digitizer  would  make  it  possible  to  eliminate  the 
mechanical  position  sensors  for  the  head  mounted  display.  Here 
we  look  at  a possible  method  for  finding  3-D  coordinates  in 
rea I — t i me . 

Ret  icon  Inc.  now  produces  a linear  array  of  photodiodes 
that  has  512  light  sensitive  elements.  Each  element  is  1 mil 
square,  so  the  entire  sensitive  portion  of  the  device  is  0.001 
inches  wide  and  0.512  inches  long. 

If  we  mount  the  device  with  a cylindrical  lens  in  front  of 
it  as  shown  in  Figure  A2.1,  then  a portion  of  the  room  is 
divided  into  512  planes  that  extend  out  from  the  focal  line  of 
the  lens.  If  an  LED  is  turned  on  somewhere  in  this  field,  some 
of  the  light  from  this  LED  will  fall  onto  the  array,  and  one  of 
the  photodiodes  will  sense  it.  Once  we  have  determined  which 
photodiode  in  the  array  was  discharged,  we  know  in  which  plane 
the  LED  I ies.  The  3-D  coordinates  of  the  LED  are  determined  by 
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using  3 or  more  of  these  systems,  fhe  point  of  intersection  of 
3 or  more  planes  gives  the  position  of  the  LED. 

The  problem  with  this  approach  is  in  the  time  required  for 
the  light  from  the  LEO  to  discharge  the  photodiode.  If  the 
diode  cannot  be  discharged  in  a time  somewhat  less  than  1/30 
second,  then  this  device  is  not  of  much  value  for  real-time 
poeition  detection. 

The  energy  required  to  saturate  one  of  the  photodiodes  is 
58.4*10#6  ergs.  A typical  LED  radiates  0.07E3  microwatts  per 
square  centimeter  at  10  feet.  If  we  do  not  have  the  lens  to 

focus  the  light  from  the  LED,  then  the  incident  area  is  the 
size  of  one  of  the  photodiode  elsements,  or  1086  square 
inches.  In  this  case  the  energy  incident  on  it  is  4.88vfl0~86 

erge/eec.  This  gives  11.95  seconds  for  the  time  required  to 
saturate  the  photodiode.  If  we  can  use  a 1 inch  wide  aperture 
in  front  of  a cylindrical  lens,  then  this  time  is  reduced  to 
approximately  1/50  second,  which  is  closer  to  the  required 
t i me. 

The  obviouc  problem  with  this  approach  is  in  the  optics. 
If  there  were  some  optical  system  that  would  focus  the  entire 
field  of  view  in  the  room  onto  a line,  then  we  would  gain 
several  orders  of  magnitude  in  energy  incident  on  an  element  in 


the  array,  thereby  reducing  the  Integration  time.  A eimple 
cylindrical  lone  does  not  do  this.  It  will  focus  one  point  in 
the  room  onto  a line  in  ths  image  space  of  the  lens,  but  if  the 
point  Is  moved,  ths  line  moves.  The  result  is  that  a 
cylindrical  lens  focuses  the  room  onto  a plane.  Nonetheless, 
thie  approach  appears  to  be  a promising  method  for  real-time 
position  detection. 
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